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DETAILED ACTION 

Response to Arguments 

Applicant's arguments filed 6/17/2009 have been fully considered but they are not 
persuasive. The Examiner does not see how CML as claimed by the applicant is any 
different.than UIML as disclosed by Abrams. Abram's UIML meets the limitations of the claims 
the in the same manner as the disclosed CML. The applicant argues over and over that UIML is 
application dependent but according to the abstract of Abrams an interface designer can use 
UIML to program many applications. Therefore it is application independent. 

The applicant needs to explain how the disclosed CML differs in implementation from 
UIML if the applicant wants to further prosecution because the Examiner does not see any 
difference. Such an explanation would be valuable to clear the record and to simplify issues 
should the application return to appeal. 

Claim Rejections - 35 USC § 102 

The following is a quotation of the appropriate paragraphs of 35 U.S. C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a printed publication in this 
or a foreign country, before the invention thereof by the applicant for a patent. 

Claims 1-4, 6-7, 29-30, 35-37, 39-48, 50, 51, 73, 74, 79-81, 83-87,and 89-91 are rejected 
under 35 U.S. C. 102(a) as being anticipated by the article entitled "UML: An Application- 
Independent XML User Interface Language" by Abrams et al. 
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Abrams teaches the invention as claimed (As in exemplary claim 90) including a browser 
apparatus for use in providing access to an application by a user through one or more computer- 
based devices, comprising a machine readable medium containing computer executable code 
which when executed permits the implementation of the steps of: obtaining the application from 
an application server (Section 2, "Allow efficient download of user interfaces over networks to 
Web browsers), the application being programmatically represented by interaction that the user 
is permitted to have with one or more computer-based devices by interaction-based programming 
components (Section 1), wherein the interaction-based programming components are 
independent of content/apphcation logic and presentation requirements associated with the 
application (Section 2, "Create natural separation of user interface from non-interface code"); 
and transcoding the interaction-based programming components on a component by component 
basis to generate one or more modality specific renderings of the application on the one or more 
computer-based devices (Abstract). 

As to claim 45, Abrams teaches multiple devices (the abstract discusses devices). 

As to claim 46, See Introduction, Abrams discusses the invention as being an interface 
for web and network applications (servers). 

As to claim 47, See page 1669 which talks about the user interface being separate from 
the non user interface code. 

As to claim 48, see first paragraph of the conclusion. 

As to claims 50 and 51, see page 1706 for example. 
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As to claim 73, Abrams teaches a step of providing a mechanism for defining logical 
input events and the association between the logical input events and physical input events that 
trigger the defined logical input events (section 3). 

As to claim 74, Abrams teaches XSL (see abastract). 

As to claims 35, 79, 89, Abrams teaches code for permitting cosmetic altering of a 
presentational feature associated with one or more modality-specific renderings of an application 
on one or more computer-based devices in an integrated speech based browsing system 
(Abstract). 

As to claim 80, Abrams teaches a step of including code for permitting changes to rules 
for transcoding on a component by component basis to generate the one or more modality 
specific renderings of the application on the one or more computer-based devices (Abstract). 

As to claim 8 1 , Abrams teaches a definition of an underlying data model being populated 
is separated from a markup language defining user interaction (Section 3). 

As to claims 83-87, The use of XML for transcoding purposes in Abrams anticipates 
these features. 

As to claims 1-4, 6-7, 29-30, 35-37, 39-43, and 90-91 they are rejected for the same 
reason as claims 44-48, 50, 51, 73, 74, 79-81, and 83-87. 

Claim Rejections - 35 USC §103 

The following is a quotation of 35 U.S. C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
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having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

Claims 5 and 49 are rejected under 35 U.S.C. 103(a) as being unpatentable over Abrams. 

As to claim 49, Abrams teaches claim 44; however; Abrams does not specifically teach 
the use of VoiceXML. 

Page 2 of the applicant's specification states that VoicXML was well known at the time 
of the invention and that implementation details were available at a website. Therefore 
VoiceXML for speech synthesis is nothing more than an obvious design choice. 

It would have been obvious for one of ordinary skill in the Computer Networking art at 
the time of the invention to combine the teachings of Abrams regarding a speech application 
system with VoiceXML because VoiceXML a well known format for speech synthesis. 

As to claim 5, it features the same limitation as claim 49 and is thus rejected for the same 
reason as claim 49. 

Claims 8-28, 34, 52-72, and 78 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Abrams in view of U.S. Patent Number 6,269,336 to Ladd et al. 

As to claims 52-56, Abrams teaches an generic interface between an application and a 
device however Abrams does not explicitly teach a dialogues. 

Ladd teaches the claimed dialogue elements (col. 12, lines 30-67). 

It would have been obvious to one of ordinary skill in the Computer networking art at the 
time of the invention to combine the teachings of Abrams regarding the transcoding of 
application components with the teachings of Ladd regarding the use of dialogue elements 
because dialogue elements facilitate interaction with a user and an application component. 
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As to claim 57, Abrams teaches the invention of claim 44 however; Abrams does not 
explicitly teach the use of conversational gestures. 

Ladd teaches interaction-based programming components represent conversational 
gestures (col. 12, lines 30-67). 

It would have been obvious to one of ordinary skill in the Computer networking art at the 
time of the invention to combine the teachings of Abrams regarding the transcoding of 
application components with the teachings of Ladd regarding the use of conversational gestures 
because conversational gestures facilitate interaction with a user and an application component. 

As to claim 58, Ladd teaches conversational gestures comprising a gesture for 
encapsulating contextual informational messages to the user (col. 12, lines 30-67). 

As to claim 59, Ladd teaches conversational gestures comprising a gesture for 
encapsulating contextual help information (col. 12, lines 30-67). 

As to claim 60, Ladd teaches conversational gestures comprising a gesture for 
encapsulating actions to be taken upon successful completion of another gesture (col. 12, lines 
30-67). 

As to claim 61, Ladd teaches conversational gestures comprising a gesture for 
encapsulating yes or no based questions (col. 12, lines 30-67). 

As to claim 62, Ladd teaches conversational gestures comprising a gesture for 
encapsulating dialogues where the user is expected to select from a set of choices (col. 12, lines 
30-67). 

As to claim 63, Ladd teaches a gesture comprising a subelement that represents the set of 
choices (col. 12, lines 30-67). 
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As to claim 64, Ladd teaches a gesture comprising a subelement that represents a test that 
the selection should pass (col. 12, lines 30-67) 

As to claim 65, Ladd teaches a gesture comprising a subelement that represents an error 
message to be presented if the test fails (col. 12, lines 30-67). 

As to claim 66, Ladd teaches conversational gestures comprising a gesture for 
encapsulating rules for validating results of a given conversational gesture (col. 18, lines 56-65). 

As to claim 67, Ladd teaches conversational gestures comprising a gesture for 
encapsulating grammar-processing rules (col. 18, lines 56-65). 

As to claim 68, Ladd teaches conversational gestures comprising a gesture for 
encapsulating dialogues that help the user navigate through portions of the application (col. 12, 
lines 30-67). 

As to claim 69, Ladd teaches conversational gestures comprising a gesture for 
encapsulating a request for at least one of user login and authentication information (col. 21, 
lines 25-40). 

As to claim 70, Ladd teaches conversational gestures comprising a request for 
constrained user input (col. 12, lines 30-67). 

As to claim 71, Ladd teaches conversational gestures comprising a request for 
unconstrained user input (col. 12, lines 30-67). 

As to claim 72, Ladd teaches conversational gestures comprising a gesture for controlling 
submission of information (col. 12, lines 30-67). 

As to claim 78, it is rejected for the same reasons as claim 57, as conversational gestures 
are interpreted as natural language. 
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As to claims 8-28 and 34, they feature the same limitations as claims 52-72 and 78 and 
are rejected for the same reasons as claims 52-72 and 78. 

Claims 31-32 and 75-76 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Abrams. 

As to claim 31, 32, 75 and 76, Abrams does not explicitly teach the use of a Java Bean 
and Java server pages for transcoding components however Abrams does teach the use of Java. 

The use of Java Beans and Java Server pages for transcoding is considered to be an 
obvious design choice. If it were not obvious on how to implement such a feature to one of 
ordinary skill then the applicant's specification would have had to provide some details in order 
to meet the enablement requirement. As it stands the applicant's specification provides minimal 
details on the subject (See page 45 of the applicant's specification). 

It would have been obvious to one of ordinary skill in the Computer Networking art at the 
time of the invention to combine the teachings of Abrams regarding an extensible system with 
the Java and Java Beans because Java provides multi-platform functionality to an application. 

As to claims 31-32, they feature the same hmitations as claims 75-76 and are rejected on 
the same basis as claims 75-76. 

Allowable Subject Matter 

Claims 33, 38, 77, 82, and 88 are objected to as being dependent upon a rejected base 
claim, but would be allowable if rewritten in independent form including all of the limitations of 
the base claim and any intervening claims. 
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The following is a statement of reasons for the indication of allowable subject matter: 
With respect to claims 38 and 82, the prior art does not teach or suggest a node id attribute as 
claimed. With respect to claims 33, 77, and 88, the prior art does not teach or suggest any 
synchronization between modalities as claimed. 

Conclusion 

THIS ACTION IS MADE FINAL. Apphcant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to DOUGLAS B. BLAIR whose telephone number is (571)272- 
3893. The examiner can normally be reached on 9:00am-5:30pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Andrew Caldwell can be reached on (571) 272-3868. The fax phone number for the 
organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 



/Douglas B Blair/ 

Primary Examiner, Art Unit 2442 



